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Introduction 



A rational group of hermitian type is a Q-simple algebraic group G such that the symmetric space 



> 

• T> of maximal compact subgroups of the real Lie group G(M) is a hermitian symmetric space of the 
non-compact type. There are two major classes of subgroups of G of importance to the geometry of T> 
and to arithmetic quotients Xr = T\T> of T>: parabolic subgroups and reductive subgroups. The former 
are connected with the boundary of the domain T>, while the latter are connected with submanifolds 
ON ■ V of the interior of T>, a priori just symmetric spaces. Under certain assumptions on the reductive 
subgroup, T>' C T> is a holomorphic symmetric embedding, displaying T>' as a sub-hermitian symmetric 
space. It is these latter groups we study in this paper, and we call them quite generally "symmetric 
subgroups" ; these are the subgroups occuring in the title. 

The purpose of this paper is to prove an existence result of the following kind: given a maximal 
Q-parabolic P C G, which is the stabilizer of a boundary component F, meaning that P(M) = N(F), 
there exists a Q-subgroup N C G, which is a symmetric subgroup defining a subdomain T>n C T> 
. such that: F is a boundary component of T>n- To formulate this precisely, we make the following 
assumptions on G which are to be in effect throughout the paper: G is isotropic, and G(R) is not a 
product of groups of type 6X2 (K). The basis of our formulation is the notion of incident parabolic and 
symmetric subgroups. We first define this for the real groups. Fix a maximal R-parabolic P C G(R), 
and let as above F C T>* denote the corresponding boundary component stabilized by P. First assume 
that F is positive-dimensional. Let N C G(R) be a symmetric subgroup; we shall say ./V and P are 
incident, if the following conditions are satisfied. 

1) N has maximal R-rank, that is, rank R iV = rank R G. 

2) N is a maximal symmetric subgroup. 

3) N = Nix N2, where N\ C P is a hermitian Levi factor of P for some Levi decomposition (these 
terms are explained in more detail in the text). 

From work of Satake and Ihara one knows, up to conjugation, all subgroups N fulfilling the above; 
these results are collected in Table [j], and such a group is uniquely determined up to conjugation 
(by an element of K C G(R), a maximal compact subgroup). It is trickier to define something 
similar for the case dim(i ? ) = 0. This is easiest to see by considering the geometric equivalent of the 
conditions above. They state that the subdomain T>n defined by has the same R-rank as T>, is a 
maximal subdomain, and finally, that T>n contains the given boundary component F in its boundary, 
F C Pjv, and furthermore that T>n = T>\ x P2, where T>\ is (as an abstract hermitian symmetric 
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space) isomorphic to F. The condition 1) is still a natural one to assume, but 2) is in general too 
strong, while 3), in the case of dim(i ? ) = 0, seems to imply 2? at should be irreducible and contain F 
as a boundary component. We then replace, for dim(F) = 0, the conditions 2) and 3) by 2') and 3') 
below: 

2') N is a maximal subgroup of tube type, i.e., such that XV is a tube domain. 
3') "Dat is maximal irreducible and contains F as a boundary component. 

The subgroups ./V fulfilling 1), 2), 3') or 1), 2'), 3') are also known and are listed in Table ||. But there 
simply do not always exist such subgroups; more precisely, for the domains 

(£2?) I q , q , II n , n even, III n , 

there are no subgroups N fulfilling the above. So in these cases, we introduce the conditions 

2") N is minimal, subject to 1). 

3") T>n contains F boundary component. 

It is clear that condition 1) and 2") together imply that the domain T>n is a polydisc, T>n = (Pi,].)*, 
where t = rank R G, and T>n = SL2(M.)/K is the one-dimensional disc. Altogether these conditions 
insure that for any maximal K-parabolic P C G(R), there is a finite set of incident symmetric subgroups 
N C G(R), such that any subgroup incident to P is isomorphic to one of them. Moreover, if F is 
positive-dimensional, N is unique up to isomorphism. 

Recall now that given G(R) of hermitian type, rank R G(R) = t, one can find t strongly orthog- 
onal roots m,...,fit which determine a unique maximal R-split torus A C G(R), the correspond- 
ing root system &(A,G), as well as a set of simple R-roots. The closed, symmetric set of roots 
\P = {±{/ii}, . . . , ±{fi t }} then determines a (unique) R-subgroup Nq, C G(R), which is isomorphic to 
(SL/2(M.)) t . Conversely, the maximal R-split torus A defines the root system $(A, G), and in this root 
system there is a good unique choice for the strongly orthogonal roots (i\ , . . . , fit (see section |1.1| ) , so A 
determines ^/ and Vl/ determines A. For each of the symmetric groups above, it is natural to consider 
also the condition 

4) Assume the parabolic P is standard with respect to A. Then C N, where ^ and A determine 
one another in the manner just described. 

We then pose the following problem. Given the rational group of hermitian type G, and given a 
maximal Q-parabolic P C G, find a symmetric Q-subgroup N C G, such that P and N are incident, 
meaning that N(M) and P(M) are incident in G(R) is the above sense, i.e., iV(R) fulfills 1), 2) and 
3) (if P(R) = N(F), dim(F) > ), 1), 2') and 3') or 1), 2") and 3") in the corresponding cases 
dim(F) = 0,2? (£V) respectively dim(F) = 0,2? G (£2?). 

The main result of the paper is that the problem just posed can be solved in almost all cases, 
specified in the following theorem. 

Main Theorem Let G be Q-simple of hermitian type subject to the restrictions above (G(M) not a 
product o/5L2(R) ' s o,nd G isotropic), P C G a maximal ^-parabolic. Then there exists a reductive Q- 
subgroup N C G such that (P, N) are incident, in the sense just defined, with the following exceptions: 
In the case of zero-dimensional boundary components, 

• Index C^nm that is, G is isogenous to the group RbsuqG , G = SU(V,h), the special unitary 
group for a hermitian form h : V x V — > D, where V is a In- dimensional right D-vector space, 
D a totally indefinite quaternion division algebra which is central simple over k (k a totally real 
number field), and the Witt index of h is n. 
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In this case the k-subgroups fulfilling I), 2") (over k) and 3") and the corresponding domains are 

• n > 1: N = Res k \qN', N' = SU(Vi,ht Vl ) x ••• x SU(V n , h\y n ), where Vi is a hyperbolic plane, 
V = V\@ ••• @V n , and then N'(R) = Sp(4,R) x ■ ■ ■ x Sp(4,R), and the domain V N , is of type 
III 2 xx III 2 . 

• n = 1: N = Res k \qN' , N' = SU(VL,h\y L ), where Vl C V is a plane defined by the inclusion 
of an imaginary quadratic extension L of k, L C D (viewing V as a k-vector space), and then 
jV'(R) = SX2(R) and the domain T>jqt is of type IIIi, a disc (in particular not fulfilling 1)). 

(2) 

Moreover, there is a Q-subgroup N fulfilling also condition 4) with the exception of the index Cr, {■ 

(2) 

Hence, for indices n with n > 1 we can find N fulfilling 1) and 3"), but neither 2') nor 2"), but 
rather only 2") over k, that is, requiring N to be minimal over k. In the case n = 1, it would seem 
that there are no subgroups satisfying condition 1) at all; at any rate we could find none. This case 
was considered in detail in [ Hypfl . As a final remark, we could eliminate the exceptional status of the 



cases n > 1 by changing 2") accordingly, but we feel these groups are indeed exceptions. 

The main application of the above theorem is to arithmetic quotients of bounded symmetric 
domains. Let T C G(Q) be an arithmetic subgroup, A"r = T\D the arithmetic quotient. Since the 
subgroups N C G of the theorem are defined over Q, Tn '■= T D N(Q) is an arithmetic subgroup 
in N, and X-p N := ^n\T^n is an arithmetic quotient. Clearly X^ N C X^, and, viewing X^ as an 
algebraic variety, is a subvariety, which we call a modular subvariety. More precisely, one has the 
Baily-Borel embedding of the Satake compactification X£, which makes X^ an algebraic variety and 
Xr a Zariski open subset of a projective variety. By a theorem of Satake [S2|, the natural inclusion 



Xy> n C Xy extends to an inclusion of the Baily-Borel compactifications, displaying X r as a (singular) 
algebraic subvariety of the algebraic variety X r . The notion of incidence then manifests itself in the 
following way. A boundary component V{ C X r (here Vi is itself an arithmetic quotient) and modular 
subvariety X rN are incident, if Vi is a boundary component of X Tn . These matters will be taken up 
elsewhere. 

Let us now sketch the idea of proof of the Main Theorem. We consider the different possibilities 
for the Q-rank of G. By assumption, G is isotropic, so rank^C? > 1. We split the possible cases into 
the following three items, corresponding roughly to increasing order of difficulty: 

1) G is split over K (explained below). 

2) G is not split over R, but rankujC > 2. 

3) rank Q G = 1. 

The first case occurs as follows. Since G is Q-simple, there is a totally real number field k and 
an absolutely simple fc-group G' such that ResuqG' = G. Let S be a maximal fc-split torus of G', 
A C G"(R) a maximal R-split torus, which one may assume contains S, S C A. Then G' is split over 
R, if S = A, i.e., a maximal fc-split torus is also a maximal R-split torus. In this case the proof of 
the main theorem is more or less trivial, and is carried out in §4. Case 2) is already more subtle; we 
combine constructions based on the correspondence between semisimple Lie algebras (of the classical 



type) and central simple algebras with involution, as presented in [W], with the known classification 
of fc-indices of absolutely simple groups, as presented in Q. This is carried out in §5, and in this 
as well as the next section most of the work is necessary for the case of zero-dimensional boundary 
components. The most interesting case, done in the last paragraph, is the case of rank one. Here 
it turns out that similar arguments as above apply in the cases that the boundary component F is 
positive-dimensional; but in the case of zero-dimensional boundary components, new arguments are 
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required. In particular, the case of hyperbolic planes is fundamental, and this was studied in detail in 
[ Hyp] . Drawing on the results of that paper we can complete the proof of the theorem. 



1 Real parabolics of hermit ian type 
1.1 Notations 



In this paper we will basically adhere to the notations of [BB]. In the first two paragraphs G will 
denote a real Lie group; later G will be a Q-group of hermitian type. We assume G is reductive, 
connected and with compact center; K C G will denote a maximal compact subgroup, T> = G/K 
the corresponding symmetric space. Throughout this paper we will assume G is of hermitian type, 
meaning that T> is a hermitian symmetric space, hence a product D = T>\ x • • • x T>d of irreducible 
factors, each of which we assume is non- compact. Let Q = t + p denote a Cartan decomposition of 
the Lie algebra of G, Qc = tc + P + + P the decomposition of the complexified Lie algebra, with p^ 
abelian subalgebras (and p c = p + p~). Chooosing a Cartan subalgebra t) C 0, the set of roots of 
g c with respect to f)c is denoted $ = $(fj<C)0c)- As usual, we choose root vectors E a £ g a such that 
the relations 

[E a ,E- a ] = H a € f) c , a(H p ) = 2 < a ' f5 > 

</3,/3> 

hold. Complex conjugation maps p + to p~, in fact permuting E a and E^ a for E a G p^. Moreover, if 
S± := {a\E a e p ± }, then 

p ± = S pan c (£ Q ), a <E E ; p = span R (X a , a <G S + , 

where X a = £/ a + E- a , Y a = i(E a — E- a ) (twice the real and the (negative of the) imaginary parts, 
respectively). Let denote a maximal set of strongly orthogonal roots, determined as in 

0: fii is the smallest root in S + , and fij is the smallest root in S + which is strongly orthogonal to 
Hi, ... , This set will be fixed once and for all. 

Once this set of strongly orthogonal roots has been chosen, a maximal M-split torus A is uniquely 
determined by Lie(A) = a = span R (X m , . . . ,X^ t ). Then $ R = $(a, g) will denote the set of K-roots, 
and g has a decomposition 

S = 3(a)© 0"> 

where Q v = {x € g[ad(s)x = rj(s)x, V s£ a}- For each irreducible component of G, the set of R-roots 
is either of type Ct or BCt, and of type Ct < ^=^ the corresponding domain is a tube domain. If £j 
denote coordinates on a dual to assuming for the moment T> to be irreducible, the K-roots are 
explicitly 

$ R : ±(& ± Cj), ±2^ (1 < i < t, i < j) (Type C t ) 

±fe ± ±2&, ±& (1 < i < t, i < j) (Type BC t ) (1) 

A R : m = ii~ = I, - ■ ■ ,t - 1, and r] t = 2£ t (Type C t ) ,r) t = £t (Type BC t ). 

Here the simple roots A R are with respect to the lexicographical order on the £j. A general R-root 
system is a disjoint union of simple root systems. The choice of maximal set of strongly orthogonal 
roots determines an order on a (the lexicographical order), which determines, on each simple R-root 
system, an order as above; this is called the canonical order. 
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1.2 Real parabolics 

The maximal R-split abelian subalgebra a, together with the order on it (induced by the choice 
of strongly orthogonal roots), determines a unique nilpotent Lie algebra of 0, n = X) g $+ 8 n - Set 
A = exp(o), N = exp(n), and 

B := Z{A) x TV; (2) 

this is a minimal R-parabolic, the standard one, uniquely determined by the choice of strongly orthog- 
onal roots. Every minimal R-parabolic of G is conjugate to B. Note that, setting M = Z(A) n K, we 
have 2(A) = M x A, and the group M is the semisimple anisotropic kernel of G. 

Assume again for the moment that T> is irreducible, and let rji, i = l,...,t denote the simple 
R-roots. Set a b := flj^Kerr/j, b = l,...,t, a one-dimensional subspace of a, and A b := exp(db), 
a one-dimensional R-split subtorus of A. Equivalently, A b = (r\j^ b Keicrjj) , where rjj is viewed as a 
character of A. The standard maximal R-parabolic, P b , b = 1, . . . ,t, is the group generated by Z(A b ) 
and N; equivalently it is the semidirect product (Levi decomposition) 

P b = Z(A b ) x U b , (3) 

where U b denotes the unipotent radical. The Lie algebra U;, of U b is the direct sum of the g 71 , rj € 
> V\a b 0- The Lie algebra 3(a&) of Z(A b ) has a decomposition: 

d (a b )=m b el b ®l' b ea b , l b = £ fl" + [tf.r"]. ft = £ fl" + ^.fl""]. (4) 

T?e[r?i, + i,...,r) t ] »/€fai,->»fc-i] 

and tTlfe is an ideal of m, the Lie algebra of the (semisimple) anisotropic kernel M. Both l b and l' b are 
simple, and the root system ... ,rj t ] is of type C t _b or BC t -b, while the root system [771, ... , 

is of type Ab-i- Let L5, L' b denote the analytic groups with Lie algebras l b and l' b , respectively, and let 
lZ b = L' b A b , a reductive group (of type Ab-i). We call L b the hermitian factor of the Levi component 
and 1Z b the reductive factor. It is well known that L b defines the hermitian symmetric space which 
is the b th (standard) boundary component of V. Indeed, letting K b C L b denote a maximal compact 
subgroup, V b = L b /K b is hermitian symmetric, and naturally contained in V as a subdomain, V b C V. 
Let C : V — ► p + be the Harish-Chandra embedding, and let D = ((D), D b = ((D b ) denote the 
images; D b is a bounded symmetric domain contained in a linear subspace (which can be identified 
with p£ = l b:C n p + ). Let o b = —(E^ + • • • + E^ b ), 1 < b < t; as the elements o b are in p + , one can 
consider the orbits o b ■ G and o b ■ L b . Since for g G L b the action is described by o b g = o b + ((g), one has 
o b ■ L b = o b + Ci^b) = o b + Y) b , and this is the domain translated into an affine subspace (o b + pt) 
of p + . One denotes this domain by F b := o b ■ L b , and this is the b th standard boundary component of 
D. G acts by translations on the various F b , and the images are the boundary components of D; one 
has 

D = D U { boundary components } = D U [y\ =l o b ■ G^j , 

and D C p + is the compactification of D in the Euclidean topology. For any boundary component F 
one denotes by N(F), Z(F) and G(F) the normalizer, centralizer and automorphism group G(F) = 
N(F)/Z(F), respectively. Then, letting U(F) denote the unipotent radical of N(F), 

N(F b )=P b , U{F b ) = U b , Z(F b ) = Z b , G(F b ) = L b , (5) 

where Z b is a closed normal subgroup of P b containing every normal subgroup of P b with Lie algebra 
3b = m b © l' b © a b © U b , which is an ideal in p b . 

Now consider the general case, T> = T>\ x • • • x X^, T>i irreducible. For each T>i we have R-roots 
<&i,r, of R-ranks U and simple R-roots • • • , i = 1, ■ ■ ■ ,d. For each factor we have standard 
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parabolics Pi )bi (1 < bi < ij) and standard boundary components Fi ibi . The standard parabolics of G 
and boundary components of T> are then products 

Pb = Pim x ■ ■ ■ x p d,b d , Fb = F 1M x • • • x F d:bd , (b = (61,..., (6) 

and as above = N^F^). Furthermore, 

G(F h ) =: L b = L ii6l x • • • x L d:bd . (7) 

As far as the domains are concerned, any of the boundary components may be the improper 
boundary component T>i, which is indicated by setting bi = 0. Consequently, P^o = F%s) = Gi and in 
(||) and (pi) any b = (&i, . . . , < bi < ti are admissible. 

1.3 Fine structure of parabolics 

For real parabolics of hermitian type one has a very useful refinement of (||). This is explained in 
detail in ||SC[ and especially in g], §111.3-4. First we have the decomposition of Z(A b ) as described 
above, 

Z(A b ) = M b -L b - Kb, (8) 

where M b is compact, L b is the hermitian Levi factor, 7Z b is reductive (of type Ab-i), and the product 
is almost direct (i.e., the factors have finite intersection). Secondly, the unipotent radical decomposes, 

U b = Z b ■ V b , (9) 

which is a direct product, Z b being the center of U b . The action of Z{A b ) on U b can be explicitly 
described, and is the basis for the compactification theory of [3C|. Before we recall this, let us note 
the notations used in [SC] and |S| for the decomposition. In [{SCfl , we find 

P(F) = (M(F)G h (F)G i (F)) x U(F) ■ V(F), (10) 

and in |S), where the author uses Hermann homomorphisms k : S^ffi) — > Q to index the boundary 
component, 

B K = (G« • G( 2 )) x U K V K . (11) 



In (0), M = M b , G h = L b , G e = K b , while in (jTT|), G$ = M b ■ L b , G^ = K b in our notations. The 
action can be described as follows (||, III §3-4). 

Theorem 1.1 In the decomposition of the standard parabolic P b (see ^) and ^)) 

P b = (M b ■ L b ■ TZ b ) x Z b ■ V b , 

the following statements hold. 

(i) The action of M b ■ L b is trivial on Z b , while on V b it is by means of a symplectic representation 
p : M b ■ L b — ► Sp(V b , J b ), for a symplectic form J b on V b . 

(ii) 7Z b acts transitively on Z b and defines a homogenous self-dual (with respect to a bilinear form) 
cone C b C Z b , while on V b it acts by means of a representation a : 1Z b — > GL(V b ,I b ) for some 
complex structure I b on Vb- 

Furthermore the representations p and a are compatible in a natural sense. 
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2 Holomorphic symmetric embeddings of symmetric domains 



2.1 Symmetric subdomains 

We continue with the notations of the previous paragraph. Hence G is a real Lie group of hermitian 
type (reductive), V is the corresponding domain. We wish to consider reductive subgroups N C G, 
also of hermitian type, defining domains T>n, such that the inclusion N C G induces a holomorphic 
injection of the domains i : T>m C T>, and the i(T>^) are totally geodesic. First of all we may assume 
that K n , a maximal compact subgroup of N, is the intersection Kn = K n N; equivalently, letting 

G T> and ojv € T>n denote the base points, i(oj\r) = o. Note that conjugating N by an element of 
K yields an isomorphic group N' and subdomain i' : T>n> C V such that i'(ojv) = o, and this defines 
an equivalence relation on the set of reductive subgroups N C G as described. For the irreducible 
hermitian symmetric domains, the equivalence classes of all such N have been determined by Satake 
and Ihara ( |pl[ for the cases of V of type I p , q , H n) HI n ; U for the other cases). 

Before quoting the results we will need, let us briefly remark on the mathematical formulation 
of the conditions. For this, let T>, T>' be hermitian symmetric domains, G, G' the automorphism 
groups, 0, q' the Lie algebras, = 6©p, q' = t'ffip' the Cartan decompositions and 9, 9' the Cartan 
involutions on and q' , respectively. To say that for an injection ix> ■ T> <^-> V of symmetric spaces, 
It>(P) is totally geodesic in V is to say that ix> is induced by an injection i : g q' of the Lie algebras. 
If this holds, ix> is said to be strongly equivariant. Then, 9 = 9'\i^y or t = Q PI p = g n p'. Since 
both I? and P' are hermitian symmetric, there is an element £ in the center of t (resp. £' in the center 
of t'), such that J = ad(£) (resp. J' = ad(£')) gives the complex structure. To say that the injection 
ix> ■ T> > T>' is holomorphic is the same as saying i o J = J' o i, or equivalently, 

(Hi) i o ad(£) = ad(0 o i. 

This is the condition utilized by Satake and Ihara in their classifications. The condition (Hi) is clearly 
implied by 

(h 2 ) i(o = e, 

which however, if fulfilled, gives additional information. For example (|S^], Proposition 4) if T> is a 
tube domain and i satisfies (H2), then T>' is also a tube domain. Furthermore, (|S|], Proposition II 8.1), 
if %x> ■ T> — > T>' is a holomorphic map which is strongly equivariant, the corresponding homomorphism 

1 fulfills (Hi), and, moreover, if T> and V are viewed as bounded symmetric domains D, D' via the 
Harish-Chandra embeddings, then in : D — > D' is the restriction of a Cdinear map i + : p + — > (p') + - 
If ic '■ 0c — * 8c denotes the Cdinear extension of i, and a : Qc — * 0c > c' : 0c — ^ 0c denote the 
conjugations over and q' , respectively, then the condition 9 = O'ur^ is equivalent to the condition i c o 
a = <t' oi c . This implies that % : (0, ^) — > (0', ^') gives rise to a symmetric Lie algebra homomorphism 
(0Cj ') — > (flcj" 7 ')) an d therefore, by Proposition I 9.1, to a homomorphism of Jordan triple 
systems i + : p + — > (p') + - It follows (fSy, p. 85) that the following three categories are equivalent: 

(SD) Category whose objects are symmetric domains (T>, o) with base point o, whose morphisms 
px> : (T>, o) — > (T>', o') are strongly equivariant holomorphic maps px> '■ T> — > V with 
Pv(o) = d . 

(CHX) Category whose objects are semisimple Lie algebras (0,£) of hermitian type (without 
compact factors), whose morphisms p : (0,£) — ► (0',^') are homomorphisms satisfying 
(Hi). 

(CK$) Category whose objects are positive definite hermitian Jordan triple systems p + , whose 
morphisms p+ : p + — > (p') + are C-linear homomorphisms of Jordan triple systems. 
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Table 1: Symmetric subdomains incident with positive-dimensional boundary components 



V 


F b , (b<t) 




(Ha) 




Ip-b,q-b 


Ip-b,q-b x Ib,b 


p = q 


H n 


Hn-2b 


II n . 2 b X II 2b 


yes 


III n 


Uln-b 


III n . b X III b 


yes 


IV n 


IVi 


IVi x IVi 


yes 


V 


15,1 


15,1 X I M 


yes 


VI 


IVio 


IVio x IVx 


yes 




IVi 


IV i x IVio 


yes 



2.2 Positive-dimensional boundary components 

We now quote some results which we will be using. First, assume we have fixed A C G as above, and 
let Fb C D be a standard boundary component of positive dimension, i.e., if T> is irreducible, of rank 
t, then b < t; if T> = T)\ x • • • x T>d, then in the notations of (P), b = (b\, . . . , bd), we have bi < ti for 
at least one i. If T> is irreducible, we list in Table |l] a positive-dimensional boundary component and 
a symmetric subdomain T>m C T> with the property that T>n = T>p x T>', where T>p is, as a hermitian 
symmetric space, isomorphic to the given boundary component. If T> is reducible, D = T)\ x ■ • • x T>d, 
and i 7 ^ C D is a standard boundary component, we get a subdomain T>n = E'jVi x • • • x T>n a such 
that XVj C T>i is of the type just mentioned with respect to the boundary component C D.;. 

Next, choose JVcG with T>n as in Table g, such that A C N is a maximal R-split torus in N, so 
that we can speak of standard boundary components of T>^. Then the subdomains T>m listed in Table 
H have the following property. For simplicity we will assume from now on that G is semisimple. 

Proposition 2.1 Given G, simple of hermitian type with maximal R-split torus A and simple R-roots 
f]i (1 < i < t = rank R G ), let Pb and Fb denote the standard maximal R-parabolic and standard boundary 
component determined by % (b < t). Let N C G be a symmetric subgroup with A C N, defining a 
subdomain T>n as in Table @, such that N = N x x N 2 and N x is a hermitian Levi factor of Pb . Let 
Po x Pt 2 be the standard maximal parabolic defined by the last simple R-root rjt 2 of the second factor 
in the decomposition N = Ni x N 2 . Then if F := Fq x Ft 2 (= Z?jvi x {pt.}, t 2 = rank R N 2 ) denotes 
the corresponding standard boundary component, the equality iw(F) = Fb holds, where i^ : T>n — ► T> 
denotes the injection. 

Proof: From construction, F = PjVi x {pt} = Fb as a hermitian symmetric space; to see that they 
coincide under ijy, recall from (^) the root space decomposition of the hermitian Levi component of 
Pb- Since A C N is also a maximal R-split torus of N, in the root system $(A,N) we have the 
subsystem [r/b+i, •••,??*] giving rise, on the one hand to the hermitian Levi factor [j, in pb, on the other 
hand to the Lie algebra of the first factor rii of N. From this it follows that Pb stabilizes ipj(F), hence 
i N {F) = F b . a 

Before proceeding to the case of zero-dimensional boundary components, we briefly explain how 
the subgroups N C G (which are not unique, of course) arise in terms of isymmetric/hermitian forms, 
at least for the classical cases. For this, we note that G can be described as follows (we describe here 



8 



certain reductive groups; the simple groups are just the derived groups): 

I I p , q : G is the unitary group of a hermitian form on C p+q of signature (p, q) 
(P> q). 

II II n : G is the unitary group of a skew-hermitian form on H n . 

(12) 

III III n : G is the unitary group of a skew-symmetric form on R . 

IV IV n : G is the unitary group of a symmetric bilinear form on R n+2 of signature 
(n,2). 

Each of the isymmetric/hermitian forms is isotropic, and if t = rank R G, the maximal dimension of 
a totally isotropic subspace is t = q, [^] , n, 2 in the cases I, II, III, and IV, respectively. Each 
maximal real parabolic is the stabilizer of a totally isotropic subspace, and using the canonical order 
on the R-roots as above, Pb stabilizes a totally isotropic subspace of dimension b. Choosing a maximal 
torus T (resp. a maximal R-split torus A C T) amounts to choosing a basis of V (resp. choosing a 
subset of this basis which spans a maximal totally isotropic subspace), and the standard parabolic is 
the stabilizer of a totally isotropic subspace spanned by some part of this basis. Now let H C V be 
a totally isotropic subspace with basis hi, . . . , h\>. Then there are elements h±, . . . , h' b of V such that 
h(hi,h'j) = 5ij, h(hi,hi) = h{h! i) h!^) = 0, and hi, . . . , hf,, h' 1} . . . , h' b span (over D) a vector subspace 
W C V on which h restricts to a non-degenerate form. Let W 1 - denote the orthogonal complement of 
W in V, W © W x = V. Then 

N := U(W,W L ;h) := {g G U(V,h)\g(W) C W,g{W L ) C W L } U(W,h {w ) x U(W x ,h ]w ±). (13) 

iV is a reductive subgroup of G, and as one easily sees, its symmetric space is just the domain denoted 
T>n in Table [l] above. The relation "boundary component C symmetric subdomain" translates into 
"totally isotropic subspace C non-degenerate subspace", H C W, and because h\w is non-degenerate, 
any g € U(V, h) which stabilizes W automatically stabilizes its orthogonal complement in V as in 

2.3 Zero-dimensional boundary components 

We now would like to consider the zero-dimensional boundary components, which correspond in the 
above picture to maximal totally isotropic subspaces. The construction above (|l3|) doesn't necessarily 
work in this case, as W 1 - may be {0}, and N = G. However, in terms of domains, given any subdomain 
T>' C T>, it can be translated so as to contain a given zero-dimensional boundary component. We 
therefore place the following three conditions on such a subdomain: 

1) The subdomain T>' has maximal rank (rank R G" = rank R G). 

2) The subdomain T>' is maximal and G' is a maximal subgroup, or 

2') The subdomain T>' is maximal of tube type and G' is maximal with this property. 

3') The subdomain T>' is maximal irreducible, and F is a boundary component of V . 

In Table | we list the subdomains (after [§) V fulfilling 1), 2) and 3') in the column titled 'TV' . We 
have listed also those subgroups fulfilling 1), 2') and 3') in the column titled "maximal tube". 

In Table if there is no entry in the column "Pat", no such subgroups exist. In these cases 
it is natural to take the polydisc T>m^ defined by the maximal set of strongly orthogonal roots 
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Table 2: Symmetric subdomains incident with zero-dimensional boundary components 



V 


v N 


(H 2 ) 


maximal tube 


i P ,q, p > q 


Vl,q 


no 


Iq,q 










II n , n even 








II n , n odd 


Hn-1 


yes 


Hn-l 


Uln 








iv n 


IV n .i 


yes 


IV n .i 


V 


I 2 ,4, II 5 , IV 8 


yes, no, no 


I 2 ,2,Il4,IV 8 


VI 


13,3, 116 


yes 


13,3, 116 



In the column "£>jv" the subgroups fulfilling 1), 2) and 3') are listed, and in the column "maximal tube" the 
subgroups fulfilling 1), 2') and 3') (i.e., not necessarily 2)) are listed. 



^ = {±{/ii}, . . . , ±{u t }} as the subdomain T>n, as there is no irreducible subdomain, and other 
products already occur in Table |l[ Hence for these cases we require the conditions 2") and 3") of the 
introduction. To sum up these facts we make the following definition. 

Definition 2.2 Let G be a simple real Lie group of hermitian type, A a fixed maximal R-split torus 
defined as above by a maximal set of strongly orthogonal roots, rji, i = 1, . . . , t the simple M-roots, Ff, a 
standard boundary component and Pb the corresponding standard maximal M-parabolic. A reductive 
subgroup N C G (respectively the subdomain T>n CD) will be called incident to Pb (respectively to 
Fb), if T>n is isomorphic to the corresponding domain of Table [I] (6 < t) or Table ^ (6 = t), and if N 
fulfills: 

• b<t, then N satisfies 1), 2), 3). 

• b = t, V$- (£T>), then N satisfies 1), 2'), 3'). 

• b = t, V £ (£V), then N satisfies 1), 2"), 3"). 

For reducible T> = T>\ x • • • x T>d, we have the product subgroups N^i x • • • x Nb dj d, where T>N b . is 
incident to the standard boundary component F^ of T>i (and Nq^ = Gi). 

Next we briefly discuss uniqueness. We consider first the case of positive-dimensional boundary 
components. Let Pb, 1 < b < t be a standard parabolic and let Lb be the "standard" hermitian Levi 
factor, i.e., such that Lie(Lb) = lb', then 

N b := L b x Z G (L b ) (14) 



is a subgroup having the properties of Proposition |2.1| , unique since Lb is unique. We shall refer 
to this unique subgroup as the standard incident subgroup. The different Levi factors C in Levi 
decompositions Pi = C x TZ u (P b ) are conjugate by elements of TZ U (P{,), as is well known. This implies 
for the hermitian factors L = £ herm c. C (which are uniquely determined by C) by Theorem LI the 
following. 

Lemma 2.3 Two hermitian Levi factors L, L' C Pb are conjugate by an element ofVbC. Pb- 

It follows, since g(Lb X Zc{Lb))g~ l = gLbg^ 1 x ZcigLbg' 1 ), that two subgroups N, N', both incident 
with Pb, are conjugate by an element of Vb' 

N, N' incident to P b <=^ N, N' conjugate (in G) by g e V b . 



10 



Proposition 2.4 If (JV, P&) are incident, there is g G V b suc/i i/iai Af is conjugate by g to the standard 
N b ofg$). 



Proof: Since N is incident, N = N\ x A^, where iVi is a hermitian Levi factor of N. By Lemma 2.3 
N\ is conjugate by 5 G 14 to Lj, the hermitian Levi factor with Lie algebra [5 in the notations of the 
last section. Hence gNg~ x = g(Ni x N 2 )g' 1 = gNig' 1 x gN 2 g' 1 = L b x AT 2)6 = iV 6 , with N 2>b = Z{L h ) 
(this follows from the maximality of N b ). Consequently, N is conjugate by g G Vj> to iVj. □ 

The situation for zero-dimensional boundary components is more complicated, so we just observe 
the following. Suppose V (££>), and that Z?tv C T> is incident to i^, P t =point. For any g G N{F t ) = 
Pt, gT>N = T>' C T> is another subdomain, again incident to Ff. If g G Pt Ci Nt, then gT>' = T>n- In 
this sense, letting Q t = Pt r\ N t , the coset space Pt/Qt is a parameter space of subdomains incident 
with Ff. 

Above we have defined the notion of symmetric subgroups incident with a standard parabolic. Any 
maximal R-parabolic is conjugate to one and only one standard maximal parabolic, P = gP b g~ l for 
some b. Let A^ be any symmetric subgroup incident with P b . Then just as one has the pair (Pi, N b ) 
one has the pair (P, N) , 

P = gP b g-\ N = gN b g-\ (15) 



Definition 2.5 A pair (P, N) consisting of a maximal R-parabolic P and a symmetric subgroup Af is 
called incident, if the groups are conjugate by a common element g as in (15) to a pair (P b , N b ) which 
is incident as in Definition p3 



3 Rational parabolic and rational symmetric subgroups 
3.1 Notations 

We now fix some notations to be in effect for the rest of the paper. We will be dealing with algebraic 
groups defined over Q, which give rise to hermitian symmetric spaces, groups of hermitian type, as we 
will say. As we are interested in the automorphism groups of domains, we may, without restricting 
generality, assume the group is centerless, and simple over Q. Henceforth G will denote such an 
algebraic group. To avoid complications, we exclude in this paper the following case: 

Exclude: All non-compact real factors of G(R) are of type SX2(R). 

Finally, we shall only consider isotropic groups. This implies the hermitian symmetric space T> has no 
compact factors. By our assumptions, then, we have 

(i) G = ResuqG', k a totally real number field, G' absolutely simple over k. 

(ii) T> = T>i x ■ ■ ■ x T>d, each T>i a non-compact irreducible hermitian symmetric space, d = [k : Q]. 

We now introduce a few notations concerning the root systems involved. Let denote the set 
of embeddings a : k — ► R; this set is in bijective correspondence with the set of infinite places of 
k. We denote the latter by v, and if necessary we denote the corresponding embedding by o~ v . For 
each a G Sqo, the group a G' is the algebraic group defined over o~(k) by taking the set of elements 
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g a , g £ G' . For each infinite prime v we have G kv — ( <t "(j / )r, and the decomposition of T> above can 
be written 

V = I] V a := (°G%/K (a) = ( a G%/Kf a) . 

Since G' is isotropic, there is a positive-dimensional fc-split torus S' C G' , which we fix. Then ° S 
is a maximal <r(£;)-split torus of a G' and there is a canonical isomorphism S' — > a S' inducing an 
isomorphism = $(S',G') — ► $ (7 ( fc )( <T S", a G') =: The torus Res k \ q S' is defined over Q and 

contains S as maximal Q-split torus; in fact S = S' , diagonally embedded in Res^qS'. This yields an 
isomorphism $(S,G) = and the root systems <E>q = &(S,G), and (for all <r E Sqo) are 
identified by means of the isomorphisms. 

In each group a G' one chooses a maximal R-split torus A a D °"<S", contained in a maximal torus 
defined over <r(A;). Fixing an order on X(S') induces one also on Xi^S') and X(S). Then, for each cr, 
one chooses an order on X(A a ) which is compatible with that on X( a S ), and r : X(A a ) — > X( a S') = 
X(S) denotes the restriction homomorphism. The canonical numbering on A Rj(T of simple R-roots of 
G with respect to A a is compatible by restriction with the canonical numbering of Aq ( |BB| , 2.8). 
Recall also that each fe-root in is the restriction of at most one simple R-root of G'(R) (which is a 
simple Lie group). Let = {/3i, . . . , /3 S }; for 1 < i < s set c(i, a):= index of the simple R-root of a G' 
restricting on fy. Then i < j implies c(i,a) < c(j,a) for all a £ E. 

Each simple fe-root defines a unique standard boundary component: for b £ {1, . . . , s}, 

F h := 1] F c(b,a), (16) 
which is the product of standard (with respect to A a and A Ri(J ) boundary components ^(6,0-) °f T^a- 



It follows that Fj C Fi for 1 < i < j < s. Furthermore, setting Ob := n°c(&,<j)! then ([BB], p. 472) 



F h = o h - L b , (17) 

where Lb denotes the hermitian Levi component (|7|) of the parabolic -Fb(lR) = ^(-^b)- As these are 
the only boundary components of interest to us, we will henceforth refer to any conjugates of the Lb of 



(16) by elements of G as rational boundary components (these should more precisely be called rational 



with respect to G), and to the conjugates of the parabolics Lb as the rational parabolics. 
3.2 Rational parabolics 

Let G' be as above, A& = {f3\ . . . ,(3 S } the set of simple fc-roots (having fixed a maximal fc-split torus 
S' and an order on X(S')). For b € {1, . . . , s} we have the standard maximal /c-parabolic P' h of G', 
whose group of R-points is the normalizer of the standard rational boundary component F c n^ of the 
domain T>' = G' R /K', where c(b) denotes the index of the simple R-root restricting to fa; since G' is 



absolutely simple, G' R is simple and V is irreducible. Hence Theorem 1.1 applies to P^(R). Of the 
factors given there, the following are defined over k: the product M' b L' b as well as L' b (but M' b is not 
defined over k, so the fc-subgroups are (instead of L' b and M' b ) L' b and G' b {1) := M' b L' b ), K' h ,Z' h and 
Vl. As is well known, any maximal fc-parabolic of G' is conjugate to one and only one of the PL 
and two parabolics are conjugate <J=^> they are conjugate over k. There is a 1-1 correspondence 
between the set of fc-parabolics of G' and the set of Q-parabolics of G, given by P' 1— > Res k \qP' =: P. 
The standard maximal Q-parabolic Lb of G gives a Q-structure on the real parabolic Lb(R), which is 
the normalizer in T> of the standard boundary component Lb as in (|l~6|) (see also (|6|) and (0)), where 
b = (c(b, o"i), . . . , c(6, ad))- In the decomposition of Theorem |1.1| , the factors G^ = MbLb, TZb, %b 
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and Vb are all defined over Q. In particular, for the factor G b , which we will call the Q-hermitian 
Levi factor (and similarly, we will call G'S 1 ^ the /c-hermitian Levi factor of P b ), we have 

g£>(q) = W G 'b ] Uk), z g (g£ ] )(q) = II(^ w )(( ffG 6 (1) W))- ( 18 ) 

Furthermore, the hermitian Levi factor Lb is defined over Q, and 

Lb(Q)=nr L &W)- 

We now make a few remarks about the factors of G(M) and of Lb(M). Since the map G' — ► a G' is 
an isomorphism of a £;-group onto a <r(/c)-group, the algebraic groups (over C) are isomorphic, hence 
the various a G' R are all E- forms of some fixed algebraic group. Similarly, the factors of Lb(lR) are all 
M-forms of a single C-group. However, they need not be isomorphic, unless the given C-group has a 
unique R-form of hermitian type (like Sp(2n, C)). Next we note the following. 

Lemma 3.1 Lb is anisotropic <^=^ b = s. 

Proof: The group Lb is anisotropic precisely when the boundary component L^ defined by it contains 
no other boundary components F* C F£, which means b > c for all c, or b = s. □ 

In this case the group Lb does not fulfill the assumptions we have placed on G, and our results up 
to this point are not directly applicable to Lb- Let us see how the phenomenon of compact factors of 
Lb(M) manifests itself in Lb = JJ a F c ^ b ^y Suppose some factor of Lb(K) is compact, say L\^. Then 
the symmetric space L>b j0 -i of L\fi is compact, so it is not true that 2\ CT1 = F c n, j(J1 \, hence it is also not 
true that Z?b — Pb; where L>b = IIct T^b,a 1S the symmetric space of Lb(M). However, letting D' h be the 
product of all compact factors, V^/V^ is a symmetric space which is isomorphic to Lj,- What happens 
is that in the product Lb = n ^c(6,<j) > an factors F c ( b ^ are points for which L>b j(J is compact. Hence 
whether this occurs depends on whether any factors T> a have zero-dimensional (rational) boundary 
components or not. 



3.3 Incidence 

We keep the notations used above; G is a simple Q-group of hermitian type. Our main definition gives 



a Q-form of Definition 2.5, and is the following. 



Definition 3.2 Let P C G be a maximal Q-parabolic, JVcGa reductive Q-subgroup. Then we shall 



say that (P, N) are incident (over Q), if (P(K), N(R)) are incident in the sense of Definition 2.5 



Note that in particular N must itself be of hermitian type, and such that the Cartan involution of 
G(W) restricts to the Cartan involution of N(R). Furthermore, N must be a Q-form of a product of 
groups, defining domains each of which is as in either Table g or Table g 
The main result of this paper is the following existence result. 



Theorem 3.3 Let G be Q-simple of hermitian type subject to the restrictions above (G is isotropic 
and G(M) is not a product of SL2(M)'s), P C G a <Q>-parabolic. Then there exists a reductive Q- 
subgroup N C G such that (P, N) are incident over Q, with the exception of the indices n for the 
zero- dimensional boundary components. 

We will give the proof in the following sections, where we consider separately different cases (of the Q- 
rank, the dimension of a maximal Q-split torus). But before we start, we note here that by definition, 
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if the theorem holds for standard parabolics, then it holds for all parabolics, so it will suffice to consider 
only standard parabolics. The case that G' has index \ was considered in ||Hyp|| ; in that case there 
is a unique standard parabolic Pi, with zero-dimensional boundary component; the associated iVi 



described in [ Hyp | has domain which is not a two-disc, but only a one-dimensional disc. 



4 Split over r case 

In this paragraph we consider the easiest case. This could loosely be described as an R-Chevally form. 

Definition 4.1 Let G' be as in the last paragraph, absolutely simple over k, and let be a root 
system (irreducible) for G' with respect to a maximal fc-split torus S' C G' . Let <&r be the root system 
of G"(R) with respect to a maximal R-split torus A' of the real (simple) group G'(R). We call G' split 
over R, if = <3? R as root systems, and if the indices of G' and G"(R) coincide. 

Note that the indices are independent of the split tori used to form the root system, so there is no 
need to assume S' C A' in the above definition (the notion of isomorphism of indices is obvious). 
However, one can always find split tori S',A' such that S' C A'. From = $ R it follows then that 
S' = A' , as both tori have the same dimension. 

Lemma 4.2 Let G be simple over Q (=ResuqG') ) T> = Ilo-eSoo ^o- ^ e domain defined by the real Lie 
group G(M) = IXrgx:^ G a =: Y\ a a G' R . If G' is split over R, then G a = G T for all ct,t G Hoc- 
Proof: For each a we have A a D a S', so by assumption A a = a S', and for each a the map 4> ■ &k — ► 
^a(k)( a G') is an isomorphism, and since &k — $8, 

^ ik) ( a G')^^G' M ). 

<t> 

It follows that $ R = = $a(k)( a G') = $ r ( ct Gr) = $ R . Similarly, since the index of G' is isomorphic 
to the index of G"(R) (which determines the isomorphy class of G"(R)), the index of a G' is isomorphic 
to that of CT G'(R). But the index of G'(M) is the same as a G'(R), as an easy case by case check verifies. 
For example, for type (I), all factors have the same R-rank q, hence are all isomorphic to SU(p,q). 



See Examples 4.3 below for the other cases. Hence a G (R) = r G'(R) for all a, r, as claimed. □ 



From this it follows in particular that the (standard) boundary components are determined by 
c(b, a) = b, V CT , b = (b, . . . , 6), 1 < b < t = rank Q G = rank^C = rank R G'(M). Hence they are of the 
form 

p b = n f ^ ( i9 ) 

and Fb t(T is the standard rational boundary component of V a . 

Examples 4.3: We now give examples of split over R groups in each of the cases, and any such will 
be of one of the listed types. Let k be a totally real number field. 

I. Let K\k be imaginary quadratic, V a -vector space of dimension n = p + q, and h a hermitian 
form on V defined over K. Then the unitary group U(V,h) is split over R the hermitian 

form h has Witt index q and for all infinite primes, h u has signature (p,q). 

II. Let D\k be a totally definite quaternion algebra over k (with the canonical involution), V an 
n-dimensional right vector space over D, h a skew- hermitian form on V defined over k. Then the 
unitary group U(V, h) is split over R <^=> the skew-hermitian form has Witt index [5] (n > 4). 
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III. Take G = Sp{2n,k). 

IV. Let V be a (n + 2)-dimensional fc-vector space, h a symmetric bilinear form denned over k of 
Witt index 2. Then if U(V, h) is of hermitian type, it is split over R. 

V. The Lie algebra in this case is of the form {J\)k)j the Tits algebra, where is an 

anisotropic octonion algebra and {J\)k is the Jordan algebra Q3 + for an associative algebra 05 
whose traceless elements with the Lie product form a Lie algebra of type 5li(2, 1); since G' is 
split over R, the algebra 23~ is the Lie algebra of a unitary group of a .fT-hermitian form (K\k 
imaginary quadratic as in (I)) of Witt index 1. 

VI. The Lie algebra is isomorphic to £(21^, Zk), the Tits algebra, where 21^ is a totally indefinite 
quaternion algebra over k and Zk is a fc-form of the exceptional Jordan algebra denoted J b by 
Tits. 



Lemma 4.4 In the notations above, let N'(R) C G'(K) be a subgroup such that the Lie algebra n' C g' 
is a regular subalgebra, i.e., defined by a closed symmetric set of roots \£ of the (absolute) root system 
$ of G' . Then N' is defined over k, N 1 C G' . 

Proof: From the isomorphism of the indices of G' and G'(R), it follows that any subalgebra g' C g, 
such that for some subset \l/ C <3?, the subalgebra g' is given by g' = t + X^e<i< Q V i is defined over R 
it is defined over k. The regular subalgebra n' is of this type, and it follows that N' is defined 
over k. □ 



Corollary 4.5 Let N' C G' be as in Lemma 4-4> N = ReSk\aN' C G. Then N is defined over 



To apply Lemma L4 to (/c-forms of) subgroups whose domains are listed in Tables |l| and we need to 



know which of the subgroups are defined by regular subalgebras. Ihara in [|] considered this question, 
and the result is: all isomorphism classes of groups in Table [l] and all isomorphism classes of groups 
in Table ^, with the exception of SO(n — 1,2) C SO(n, 2) for n even, have representatives which are 
defined by (maximal) regular subalgebras. 



Corollary 4.6 Let G' be split overR. Then Theorem 3.S holds for G = ResunG' 



Proof: By Lemma p~2|, G{R)/K = V = Y[V (J , and all V a are isomorphic to V = G'{R)/K'; the ratio- 
nal boundary components are as in (|l9l), products of copies of F^, the standard boundary component 
of V, and each Q-parabolic of G is conjugate to one of P& = ResuqPl, where P^(K) = N(F£) is the 
standard maximal real parabolic of G'(M). Now locate in Table |l] or ||| as the case may be; the cor- 
responding group is isomorphic to one defined by a regular subalgebra of g' m with the one exception 



mentioned above. Then by Lemma 4.4, Nl is defined over k, hence (Corollary) Nf, = RssuqN^ is de- 
fined over Q, and is incident with P^. This takes care of all cases except the exception just mentioned, 
IV n _i C IV n , n > 3 even. So let V be a fc-vector space of dimension n+2, h a symmetric bilinear form 
on V. By assumption, G' is split over R, so the Witt index of h is 2. Let H C V be a maximal totally 
isotropic subspace (two-dimensional) defined over k, and hi,fi2 a /c-basis. Then there are A;- vectors h\ 
such that Hi :=< h%, h[ > and H2 ■=< /12, h' 2 > are hyperbolic planes; let W = H\ (B H2 denote their 
direct sum. From n > 3, W has codimension > 1 in V . Let v € be a A;-vector, and set: 

U :=v ± = {w e V\h(v, w) = 0}. 
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Then W C U, the dimension of £7 is n + 2 — 1 = n + 1, and /iij/ still has Witt index 2. Hence 

N' :={geU(V,h)\g(U) C U} 

is a £;-subgroup, and iV(R) = SO(n — 1, 2). This is a group which is incident to a parabolic whose 
group of real points is the stabilizer of the zero-dimensional boundary component F 2 of the domain 
V of type IV n . □ 

This completes the discussion of the split over R case. We just mention that, at least in the classical 
cases, we could have argued case for case with ztsymmetric/hermitian forms as in the proof of the 
exception above. Using the root systems simplified the discussion, and, in particular, gives the desired 
results for the exceptional groups without knowing their explicit construction. 



5 Rank > 2 

In this paragraph we assume G in not split over R, but that rank^G' = rank Q G > 2. Under these 
circumstances, it is known precisely which /c-indices are possible for G' of hermitian type. 

Proposition 5.1 Assume rankqG > 2 and that G' is not split overR. Then the k-index of G' is one 
of the following: 

(I) 2 A^ S ; s > 2, d\n + 1, 2sd < n + 1; if d = 1, then 2s < n + 1. 

(II) 1 D®, s > 2, s < I (n = 2£); 2 D { ^ S , s>2, s < £ (n = 21 + 1). 

(Ill) eg], s>2, s< [§]. 
(TV) none 
(V) none 
(VI) E^ 2 . 

Proof: All statements are self-evident from the description of the indices in [I]]; in the case (V) there 
are three possible indices, only one of which has rank > 2; this is the split over M index. Similarly, in 
the case (IV), rank > 2 implies split over M. For type (III), the indices C^ 1 ) are also split over R. □ 

There is only one exceptional index to consider, so we start by dealing with this case. The index 
we must discuss is 

f 

with the 

fc-root r^/- 

#7,2 * q ^ ^ • O system: U\ K 

There are two simple fc-roots, 771 and 772; let be the corresponding standard maximal A;-parabolics, 
Fl the corresponding standard boundary components of the irreducible domain T>'. Then F% is the 
one-dimensional boundary component, F{ is the ten-dimensional one. The /c-root system is of type 



BC2 (since the highest simple R-root is anisotropic, see [BB], 2.9). Consider the decomposition of 



Theorem LI for P^(R); in both cases I' b is non-trivial, and, as mentioned above, M' b ■ T' b is defined 
over k. Here we have b = 1 or 2. But for E7, the compact factor M' h is in fact afrsen^], and as L' b is 
defined over k, we can set 

K = L' b x Z G ,{L' h ). 

^ee g, p. 117 
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This is a fc-subgroup which is a fc-form of the corresponding M-subgroup whose domain is listed in 
Table |l[ Now consider G = Resk\qG'. It also has two standard maximal parabolics Pi and P2, and 
in each we have a non-trivial hermitian Levi factor^] Lb := ResuqL' b , such that 



bj 



Also the symmetric subgroup iVb := Resu^N^ is defined over Q and satisfies -/Vb(M) = IIctgEoo ct (-^&)r- 
It follows that (.Pbj-^b) are incident: conditions 1) and 2) follow from the corresponding facts for 
(P^Nfr); we should check 3). But since it is obvious that CT (Lj ) ) ]R C <t (P 6 ')r is a hermitian Levi factor, 
the same holds for Lb C Pb', 3) is satisfied. This completes the proof of 

Proposition 5.2 Theorem \3. j| is true for the exceptional groups in the rank> 2, not split overW case. 

We are left with the classical cases. Here we may use the interpretation of G(M) as the unitary 
group of a ztsymmetric/hermitian form as in (|T2]), and G is a Q-form of this. The precise realisation 
of this is the interpretation in terms of central simple algebras with involution; this is discussed in 
[W]. More precisely, the algebraic groups G' which represent the indices of Proposition |5.1| are (here 
we describe reductive groups; the corresponding derived groups are the simple groups G'). 

(I) D: degree d central simple division algebra over K, K\k an imaginary quadratic extension, D 
has a LT|/c-involution (involution of the second kind). 

V: right D- vector space, of dimension m over D, dm = n + 1. 

h: hermitian form h : V X V — ► D of Witt index s, 2s < m (2s < m if d = 1), given by a 
matrix H . 

G': unitary group U(V,h) = {g G GL D {V)\gHg* = H}. 
index: 2 A^\. 



(II) D 
V 
h 
G' 



totally definite quaternion division algebra, central simple over k, with canonical involution, 
right D-vector space of dimension m over D. 

skew-hermitian form h of Witt index s < [t£] , given by a matrix H. 
unitary group U(V,h) = {g £ GL D (V)\gHg* = H}. 



index: Dm,s {jn even), 2 D^ S (m odd). 

(Ill) D: totally indefinite quaternion division algebra, central simple over k, with the canonical 
involution. 



V 
h 
G< 



right D-vector space of dimension m. 

hermitian form h : V X V — > D of Witt index s, 2 s < m, given by a matrix H. 
unitary group U(V,h) = {g G GL D (V)\gHg* = H}. 



index: Cm,s- 

Finally, we must consider the following "mixed cases" , which still can give rise to groups of her- 
mitian type: 

(II- IV): D: a quaternion division algebra over k, with D v definite for vi,...,v a , D u indefinite for 
i/ Q+ i, . . . , Uf, where f = [k : Q]. 

2 we note a change of notation here in that in (TFT) , Ly, denotes a real Lie group 
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V: same as for (II) above. 
h: same as for (II) above, h of Witt index s. 
G'\ same as for (II) above. 

G(R) is then a product (SU (n, M)) a x (SO(2n — 2, 2))f~ a , where we have taken into account that we are 
assuming G to be isotropic and of hermitian type. Note however, that since the factors S0(2n — 2, 2) 
corresponding to the primes v a +i, ■ ■ ■ , Vf have R-split torus of dimension two, the /c-rank of G' must 

(2) ' (2) 

be < 2. Hence the only indices where this can occur are: l D n ' 1 and l D\ J 2 , i = 1, 2. 

In terms of the spaces (V, h), the standard parabolics are stabilizers of totally isotropic subspaces 
Hb C V, where Hi is one-dimensional (over D), while H s is a maximal totally isotropic subspace. 
The latter case corresponds to zero-dimensional boundary components. We consider first the case 
Hf,, b < s, of which at least Hi exists, because of the assumption rank > 2. Fix a basis hi, ... ,hb of Hi, 
of isotropic vectors h(hi, hi) = for all i = 1, . . . , b. Then there exist, in V, elements h\, i = 1, . . . , b 
with h(hi,h'j) = 5{j, and h'i,...,h' b span a complementary totally isotropic subspace; denote it by 
H' b . Then H := H b © H' b is a non- degenerate space for h, h\jj is a non-degenerate form. It follows 
that {g € GL(V)\g(H) C H} = {g € GL(F)| 5 (iJ- L ) C H L }. In the following we will work in 
the (reductive) unitary group G' = U(V,h); for any subgroup H C G' we can take the intersection 
SL(V) fl H C SL(V) n G' to give subgroups of the simple group. Furthermore, up to Corollary [5J3] 
below, we omit the primes in the notations for the subgroups of G' . Set 

N = U(H, H ± ; h) = {ge GL(V)\g(H) C H, g{H L ) C H 1 }; (20) 

then N = U(H, h ]H )*U{H L ,h\ H ±.), and U{H, h\ H ) = Z G {U{H^, h\ H x)). So setting L = U{H L ,h\ H ±.), 
we have 

N^Lx Z G {L). (21) 

Next we note that the basis hi, . . . ,h\, of H b determines a unique R-split torus A b C A, where 
A is the maximal R-split torus defined by a basis hi, . . . ,h s of a maximal totally isotropic subspace 
H s D H b , namely the scalars a = a ■ 1 G GL(H b ), extended to GL(V) by unity. Taking the centralizer 
of the torus Ab gives a Levi factor of the parabolic Pb = Mc^Hb), b < s (the normalizer in G of Hb). 

Lemma 5.3 L = {/(H^, h\jjx) is the k-hermitian factor G b = Mb ■ Lb of Pb in the decomposition of 
Pb as in Theorem |i 

Proof: First observe that L C Pb, as H 1 - is orthogonal to the totally isotropic subspace, hence L 
normalizes Hb- Since L is reductive, there is a Levi decomposition of Pb for which L is contained in the 
Levi factor. It is clearly of hermitian type, and maximal with this property. We must explain why the 
Levi factor is the standard one Z{Ab). But this follows from the fact that Hb is constructed by means 
of a basis, which in turn was determined by the choice of R-split torus A b . It therefore suffices to 
explain the "compact" factor Mb. This factor occurs only in the cases I Pjq and IV n . We don't have to 
consider the latter case, as this is split over R if rank > 2. So suppose G = U(V,h), where (V, h) is as in 
(I) above. We first determine the anisotropic kernel. Let H s be a maximal totally isotropic subspace, 
S := H s © H' s as above. Then £/(£-*-, h\ s ±) is the anisotropic kernel, U(S ± , h\ s ±)(M) = U(md — 2sd). 
In particular, for m = 2s, there is no anisotropic kernel. Now consider the group L = U(H- L ,h^ H ±). 
Clearly, for b < s, we have 

U(S ± ,h ls x)cU(H ± ,h lH ^) = L, 
so that L contains the anisotropic kernel. Note that SU(H ± , h\ H ±)(W) = L^(R), while (if H 1 - ^ {0}) 

?7(^ ± ,/ l | H x)(R)/5C/(^ ± ,/ l | H x)(R) ^M b (R) 17(1). 
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Here we have used that U {H , h\ H x) C SU(V, h), as it is for the group SU (V, h) (and not for U (V, h)) 
that M b (R) = U(l) (see jS|, p. 115). This verifies the Lemma for the groups of type I. □ 

Now note that L(R) ^ (M b ■ L b )(R) = M b (R)L b (R), so for the domain defined by L we have 
V L = M b (R)L b (R)/M b (R)K b = L b (R)/K b ^ F b , hence V N £S V Nb as in Table @. Consider also Z G {L b ) 
and Z G (M b L b ); both are defined over R, and clearly Z G(JBi) (L b (R))/M b (R) -Z G(R) (M 6 (R)L fe (R)), so 
the group L x Z G (L) (both these factors being defined over k) is, over R, 

L(R) x Z G {L)(R) S M 6 (R) • L 6 (R) x Z G(R) (M 6 (R)£ b (R)) (22) 
^ M 6 (R) • L 6 (M) x Z G(1l) (L b (R))/M b (R) 
L b (R) x Z G(R) (L b (R)). 

This completes the proof of 

Proposition 5.4 T/ie subgroup N of $2(\ ) satisfies N(R) = N b (R), the latter group being the standard 
symmetric subgroup ( p 7 ^ ) standard incident to P b (R). 



Corollary 5.5 The parabolic P b and the symmetric subgroup N of (\2Q) are incident over k, i.e., 
(Pfe(R), N(R)) are incident in the sense of Definition \2. 4 - 



Up to this point we have been working with the absolutely simple fc-group; we now denote this situation 
by G' as in section 3.1, and consider G = Resu^G' . Let again primes in the notations denote subgroups 
of G', the unprimed notations for subgroups of G. As above we set Pb := R es k\Q(P b )> an d we denote 
the subgroup N' of (20) henceforth by N' b and set: iVb := Res^^N^). Then Corollary |5]5| tells us 



that (P b '(R),iV'(R)) are incident. We now claim 
Lemma 5.6 The Q-groups (Pb,^b) are incident. 

Proof: Pb(R) is a product Pb(R) = Pb,i(R) X • • • X P&d(l&) corresponding to (^6[); by assumption F b 



is not zero-dimensional. Hence for at least one factor P, )CT (R) the incident group ^iV^R) = ""L^R) x 
Za G <(jg,}( a L' b (R)) is defined. Consequently iVb is not trivial, and it is clearly a Q-form of iVb(R) = 



With Corollary |5.5| and Lemma 5.6, we have just completed the proof of the following. 



Proposition 5.7 To each standard maximal Q-parabolic Pb of G with b < s, there is a symmetric 
Q-subgroup Nb C G such that (Pb,^b) are incident. 

Finally, we remark on what happens for the parabolic corresponding to the zero-dimensional 
boundary components. We have, in the notations above, H = H s © H' s , and H 1 - is anisotropic 



for h. It follows that the group L of Lemma 5.3 is anisotropic; its semisimple part is the semisimple 
anisotropic kernel of G' . If s = ^dimF, then H = V already, H 1 - = {0}. Hence the group N of (^l|) is 
the whole group (L = 1 => Z G (L) = G). Otherwise it is of the form {anisotropic} x {fc-split}. We list 
these in Table |3|. Note that the domains occuring have R-rank equal to the Q-rank of G, suggesting 
this as a possible modification of the definition of incident: 

1') N has R-rank equal to the Q-rank of G. 

Viewing things this way, we see that again indices represent an exception; for these 1) and 1') 
are equivalent. 

Let us now see which of the subgroups listed in Table § are defined over k. We use the notations 
D, V, h and G as described above in the cases (I)-(III). 
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Table 3: A;-subgroups incident with zero-dimensional boundary components 



Index 


L 


Z G (L) 


subdomains 


Z G (L)(R) 


2 A {d) 

n,s 


/1 n~2ds,0 


2 Ad) 


Ip-ds,q-ds X Ids,ds 


SU{ds,ds) 


i D W 

^ n.s 


u n-2sfi 


U 2s,S 


Iln-s X II S 


SU{2s,M) (n even) 


2 D (2) 
^ n,s 


^-28,0 


U 2s,S 


II n . s X II s 


SU(2s,M) (n odd) 


c w 




G 








r m 




III n . s X III S 


Sp(2s, K) 



(I) Again d denotes the degree of D. In U (V, h) we have the subgroup U (V, fyy) for any codimen- 
sion one subspace V C V. Let W = (V) be the one-dimensional (over D) subspace orthogonal 
to V' . Then U (W, is again a unitary group whose set of R-points is isomorphic to U(pw, Qw) 
for some pw,1w- Actually each h v for each infinite priro.6 v gives cin IR-group U{p^ u ^ Qw,v 

). Let 

(p u ,q v ) be the signature of h v on V v . Then U{yl,h v \y^) = U(p u — p w ^,q v — q w , v )- This gives 
rise to a product N = J} U(p Wt „, q WfV ) x £/(Pi/ — p w ,v,qu — <7w>); an d the factors of the domain 
V N are of type l pWtU ,q w>v x Ip^-p^^-qv^- In particular, for p Wt „ = 0, this is an irreducible 
group of type Ip^-q^ v and for q w>v = 0, of type I Pu - Pw „, q „. Now since fc is the degree of 
£>, all of 

Pi/j qviPw,vt qw,v are divisible by and the net subdomains these subgroups (possibly) 
define are 

Ip-jd,qi Ip,q-jdi Ip-id,q-jd C Ip,q 5 i,j = 1 5 • • • > S. (23) 

(II) In C/(V, h) we have as above U(V' ,h\y); now if /i is non-degenerate on V' , then E/(V', hty) = 
U(n — 1, D), giving subgroups of the real groups, defined over k, of type U(n — 1,H) C C/(n,H), 
with a corresponding subdomain of type II n -i C II n - This occurs at the primes for which D is 
definite; at the others SU(V, h\ v ,) C SU(V, h) is of the type SO(2n - 4, 2) C SO(2n - 2, 2) (for 
n=dimension of V over L>). So we have maximal A;-domains 

II n .i C II n , [y definite), IV 2n -4 C IV 2n -2, iy indefinite). 

(2) 

(III) The index is CA;i; this case in considered in more detail below. 
From this, we deduce 

Proposition 5.8 Let G' have rank^G' = s > 2, not split over R ; and let P' s be a standard k-parabolic 
defining a zero- dimensional boundary component, -P^(R) = N(F), and dim(F) = 0. Then there is a 

(2) 

k-subgroup N' incident with P' s , with the following exception: Index g . 



Proof: We first deduce for which of the indices listed in Proposition 5.1 zero-dimensional boundary 
components of T>' are rational (this is necessary for the zero-dimensional boundary components of T> 
to be rational). We need not consider exceptional cases or type IV n . We first consider the groups of 
type 2 A. 

Lemma 5.8.1 For G' with the index 2 A^], let G'(R) = SU{p, q). Then the zero- dimensional boundary 
components are rational sd = q. 

Proof: Let H s be an s-dimensional (over D) totally isotropic subspace, with basis h%, . . . ,h s . Let 
h\ € V be vectors such that h(hi, hj) = 5ij, and set H' s =< h[, . . . , h' s >. Then h, restricted to H := 
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H S ®H' S , is non-degenerate, and SU{H , h\ H ±) is the anisotropic kernel. The group SU(H, h\}j) 
SU(sd, sd), while SU(H ± ,h\ H ±)(R) = SU(p — ds,q — ds). This defines the subdomain of type Ids,ds x 
Ip-ds,q-ds of Table [j], hence the boundary component, which is the second factor, is zero-dimensional 
q = ds. □ 

As to indices of type D we observe the following. 



Lemma 5.8.2 dim(F) = does not occur for the indices of type (II) in Proposition 5A 



Proof: Recall that D is a quaternion division algebra, central simple over k, with the canonical 
involution, V is an n-dimensional right D-vector space, and h : V x V — > D is a skew-hermitian 
form. Let u\, . . . , v a denote the infinite primes for which D u is definite, v a +i, ■ ■ ■ , v d the primes at 
which D v is split. Then G(M) is a product 



d—a 



(SU(n,M)) a x (50(2^1-2,2)) 

where we have taken into account that G is assumed to be of hermitian type. At each of the first 
factors we have the Satake diagram 




o 




for n odd, 

The corresponding R-root systems are then: 



for n even. 



o- 



o 



o 



<x 



\ 

In particular, the K-root corresponding to the parabolic Pt with dim(i ? j) = is the right-most one. 
On the other hand, the /c-index is 



o 



with the A;-root system 



o 



2s 



ill 

o 



• • • — o- 



• • • 




(24) 



o 




D 



(respectively) Q 



from which it is evident that Pt is defined over k 
Consequently, a = and D is totally indefinite. 



s = t (= [S]). But this is the split over R case. 
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So we consider a prime v where D u is split; the K- index is 



o — o 




??2 X ??1 

the R-root 772 corresponding to the two-dimensional totally isotropic subspace and zero-dimensional 



boundary component. The &;-index is as in (24), so r/2 is always anisotropic; the boundary components 



are actually one-dimensional. This verifies the statements of the lemma. 



□ 



Note that this proves Proposition 5.5 for the indices of type (II). 

(2) 

Now consider index Cn,L The /c-index is 

• — o — • o • • • — o — • — 



— 9 



and the A:-root system is 



2s 



The same reasoning as above shows that Ft is rational 



2s 



J)Vs 



index is C 



(2) 

2n,n" 



t, but that is only possible if the 



Hence: 



Lemma 5.8.3 The only indices of Proposition 5.1 , case (III), for which zero- dimensional boundary 

(2) 

components occur are C^nn- 

This index is that of the unitary group U(V, h), where V is a 2re-dimensional vector space over D, and 
h has Witt index n. We can find n hyperbolic planes V{ such that 



V = V\ 



V„ 



This decomposition is defined over k, hence the subgroup 

N = U(V u h ]Vl ) x ••• x U(V n ,h ]Vn ), 

(2) 

which is a product of groups with index C 2 {, is also defined over k. We have 

N(R) ^ 5p(4,R) x • • • x 5p(4,M) 



(25) 



n times 

and the domain T>n is of type (IIl2) n . This is the exception in the statement of the main theorem. 



Proof of Proposition |5.8[ : We have already completed the proof for (II) and (III), and as we 
mentioned above, the exceptional cases and (IV) need not be considered. It remains to show the 
existence of groups of the stated types for indices 2 A. We explained above how one can find k- 
subgroups N such that T>n has irreducible components of types I p -jd,q (see (|23|)). Here we take a 
maximal totally isotropic subspace H s , and H := H s © H' s as described there. Let H 1 - denote the 
orthogonal complement, so that SU(H ,hijj±) is the anisotropic kernel. Then, if G'(R) = SU(p,q), 
we have 

SU(H, h ]H )(R) ^ SU(sd, sd), SU(H ± , h H ±) ^ SU{p -sd,q- sd). 
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Therefore we get a sub domain of type 



Isd,sd X Ip-sd,q-sdi 



which is irreducible <^=^ sd = q; Then N = {g £ G g(H) C P} is a fc-subgroup with N(M) ~ 
SU(q,q) x {compact}, and iV then fulfills 1), 2') and 3'). By Lemma |5.8.1 , this holds precisely when 
the boundary component F s is a point. This completes the proof if p > q. It remains to consider the 
case where T>' is of type I q , q - In this case, q = d-j for some j, and the hermitian form h : V x V — * D 
has Witt index j. The vector space V is then 2j-dimensional, and it is the orthogonal direct sum of 
hyperbolic planes, V = V\ ffi • • • @ Vj, dim^Vi = 2. Consider the fe-subgroup 

N = {g e GL D (V)\g{Vi) C V i: i = 1, . . . , j}. 

Clearly N = N\X ■ ■ ■ x Nj, and each iVj is a subgroup of rank one with index 2 ^4d-i i- was s fi° wn 
in [ |Hyp |, in each N{ we have a fc-subgroup N[ C N t , with Djy/ of type (Ii,i) d . Then 



N' := N[ x 



xiVj 



is a /c-subgroup with Djv' of type ({li,i) d y = = which is a maximal polydisc, i.e., 

satisfies 1), 2") and 3"). This completes the proof of Proposition |5j| in this case also. □ 



6 Rank one 

We now come to the most interesting and challenging case. In this last paragraph G' will denote 
an absolutely simple A>group, G the corresponding Q-simple group, both assumed to have rank one. 
There is only one standard maximal parabolic P[ C G' in this case, so we may delete the subscript i 
in the notations. Let PcGbe the corresponding Q-parabolic, so P(R) = -Pi(M) x • • • x P^(R), where 
Pj/(1R) C av G'(R) is a standard maximal parabolic, say P V (R) = N(Fb v ), P&„ C V av . As we observed 
above, the are all hermitian spaces whose automorphism group is an M-form of some fixed algebraic 



group. As we are now assuming the rank to be one, it follows from Lemma 3.1 that L (=Lb in the 
notations above) is anisotropic. One way that this may occur was explained there, namely that if one 
of the factors F^ is a point, in which case the symmetric space of L(M) has a compact factor. Another 
possibility is that all F^ v are positive-dimensional, in which case L is a "genuine" anisotropic group. 
The type of Fb u can be determined from the fc-index of G' and the E-index of yG' . For example, for 
G' of type 2 A, these indices are: 

• • • o • • 



o 




1 vertices 



The /c-index of G' 
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o 



-o — o 



— o 



o- 



o 



-o — o 



q v vertices 

The R-index of a "G'(l 



From this we see that the boundary component is of type I Pl/ -d,q„-d- 

There are basically two quite different cases at hand; the first is that the boundary components are 
positive-dimensional, the second occurs when the boundary components reduce to points. The former 
can be easily handled with the same methods as above, by splitting off orthogonal complements. The 
real interest is in the latter case, and here a basic role is played by the hyperbolic planes, which have 
been dealt with in detail in | Hypfl . We will essentially reduce the rank one case (at least for the 
classical groups) to the case of hyperbolic planes, then we explain how the results of [pyp | apply to 
the situation here. 



6.1 Positive-dimensional boundary components 

Let G',P' be as above, and consider the hermitian Levi factor G'^ = M'L', which is defined over 
k. Over K the factors M'(R) and L'(R) are defined. In this section we consider the situation that 
the boundary component F' of D' defined by P' (i.e., P'(R) = N(F')) is positive-dimensional, or 
equivalently, that the hermitian Levi factor L'(R) is non-trivial. As above, we get the following 
fe-group 

N' :=G' {1) x Z G ,{G' {1) ). (26) 

The same calculation as in (|22| ) shows that the domain X>jv' defined by N' is the same as that 
defined by L'(R) x Z G /^(L'(R)). Taking the subgroup ./V = Res k \qN' defines a subdomain T>n C V, 
which is a product T>n = T^N,ai X • ■ • x T>N tCTf . Each factor 2?jv,ct is determined by the corresponding 
factor of a L'(M). The R-groups iV'(R) and iV(R) are determined in terms of the data D, V, h as follows. 

(I) If F' = I p -d,q-d) then T>fqi = I p _d,q-d x Id,d- Note that in terms of the hermitian forms, this 
amounts to the following. Since h has Witt index 1, the maximal totally isotropic subspaces 
are one-dimensional. Let Hi =< v > be such a space; we can find a vector v' G V such that 
H =< v,v' > is a hyperbolic plane, that is, h\jj has Witt index 1. It follows that hi H ± is 
anisotropic. Consider the subgroup 

N k :={geU(V,h)\g(H) C H}. (27) 

It is clear that for g € N k , it automatically holds that <7(i7 _L ) C H^~, hence 

N k U(H, h\ H ) x U{H X , h\ H x). (28) 

The first factor has R-points U(H, h\ H ){R) = U(d, d), while the second fulfills U{H^, h\ H ±)(E) = 
U(p — d,q — d). Thus N k = N' as in (p6|). At any rate, this gives us subdomains of type 

Id,d X Ip-d,q-d C^N'i 

which, in case d = p = q is the whole domain; in all other cases it is a genuine subdomain as 
listed in Table [l], defined over k, and (N',P') are incident. It follows from this that (N,P) are 
incident over (Q>. The components N a (M.) of A r b(R) are determined as follows. Let (pv,qv) be the 
signature of h v (so that p v + q v = dm for all v) . This implies 

C( R ) — IT (p p , q u ). 
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For each factor, we have the boundary component F„ = SU(p u — d,q u — d)/K, and for each 
factor for which q v > d this is positive-dimensional. As above, this leads to subdomains, in each 
factor, of type I d ,d x Ip^-d^-d; so that in sum 

Vn = Y[T> v , V v of type I d , d x Ip„. d ,q„-d • (29) 

V 

(2) 

(II) Here rank 1 means we have the following /c-index, 

— °— <[ 

In particular, the boundary component is of type II n -2 if is of type II n . This means also that 
the "mixed cases" only can occur if T>' is of type II4, for then II2 — one-dimensional disc. Of 
course II4 = IV"6 anyway, so we can conclude from this that mixed cases do not occur in the 
hermitian symmetric setting (for Q-simple G of rank 1). The domain T>^> defined by N' is of 
typell n . 2 xll 2 . The components -/V CT (R) of N\ (R) are all of type U(n — 2,U) xU(2,M) C U(n,E), 
so the domain T>n is ot type 

(II n . 2 x II 2 /. (30) 

(III) Here rank 1 implies the index is one of C±~\ (which we have excluded) or C^\- The corresponding 

(2) 

boundary components in these cases are of type III n _2. The case Cv> {, for which the boundary 
component is a point, will be dealt with later, the others give rise to a subdomain of type 
III 2 x IIIn-2- Consequently, V N is of type (III n -2 x III 2 ) / , f = [k:Q]. 

(IV) Here we just have a symmetric bilinear form of Witt index 1. The /c-index in this case is 
necessarily of the form 

o • • • 

The corresponding boundary component is a point, a case to be considered below. Splitting 
off an anisotropic vector (defined over k) in this case yields a codimension one subspace H 1 - on 
which h still has Witt index 1, hence the stabilizer N' defines a subdomain T>^i of type IV n _i. 
T>n is then of type (IV n _i)^. 

(V) The only index of rank 1 is 




■9 "6 



The vertex denoted «2 gives rise to the five-dimensional boundary component. If 5 denotes the 
lowest root, then, as is well known, 5 is isotropic (does not map to zero in the A;-root system), 
so the root 5 defines a /c-subalgebra n«5 := Q S + Q~ s + [Q S ,Q~ S ] C q' which is split over k. On 
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the other hand the anisotropic kernel K is of type 2 As, and /C(R) = U(5, 1). Clearly K, and the 
£;-subgroup N$ defined by YI5 are orthogonal, so we get a A;-subgroup 



N' = N s x K, 

both factors being defined over k. The set of R-points is then of type iV'(R) = SX2(R) x SU(5, 1), 
and the subdomain T>n> is 

V N , x I 5 ,i. 

This is one of the domains listed in Table [l], incident to the five-dimensional boundary component. 
It follows that T>n is a product of factors of this type. 

(VI) There are no indices of hermitian type with rank one for £7. 

We sum up these results in the following. 

Proposition 6.1 If the rational boundary components for G' are positive- dimensional, then Theorem 
holds for G. The subdomains defined by the symmetric subgroups N' C G' are: 



(V Id,d X Ip-d,q-d- 
(II) II n _ 2 X II 2 . 

(III) III n _ 2 X III 2 . 

(IV) IV n _i (here there are no positive-dimensional boundary components). 

(V) 11,1X15,!. 

Note here Ii,i = II2 = IIIi = IVi. The corresponding domains T>n in T> defined by the subgroups N 
are products of domains of the types listed above. 

6.2 Zero-dimensional boundary components 

The restrictions rank equal to one and zero-dimensional boundary componants are only possible for 



the domains of type I p , q , III2 and IV n (see Lemmas 5.8.2 and 5.8.3 ). Of these, the last case requires 
no further discussion: as above we find a codimension one A:-subspace V C V, on which h still is 
isotropic, and take its stabilizer as N'. This gives a fc-subgroup N' C G', and defines a subdomain 
T>ni of type IV n _i. In the 2 A^ case we may assume d > 3: the d = 1 case is again easily dealt with as 
above. We have a K- vector space V (K\k imaginary quadratic) of dimension p + q and a {K- valued) 
hermitian form h of Witt index 1 on V. By taking a -fT-subspace V' C V of codimension one, such 
that h\yi still has Witt index 1, we get the /c-subgroup N' as the stabilizer of V'. Then the domain 
T)jqi is either of type I P -i, q or I p , q -i, and by judicious choice of V we can assume the first case, which 
is the domain listed in Table ^. The d = 2 case is "lifted" from the corresponding d = 2 case with 
involution of the first kind: if D is central simple of degree 2 over K with a i^|/c-involution, then (|A[, 
Thm. 10.21) D = D' ®kK, where D' is central simple of degree 2 over k with the canonical involution. 
Consequently, 

U(V, h) = U(V ® k K, h' ® k K) = U(V', ti) K , 

the group is just the group U(V',ti) lifted to K. Since U (V, h!) has index C^, while U(V',h') K 

(2) 

has index -A 2 „_i 1, it follows that the boundary component is a point only if n < 2. This implies that 

(2) 

if d = 2, the index is A 3 [, the domain is 12,2 — TV4, so U(V ,h)x is isomorphic to an orthogonal 
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group over k in six variables. As we just saw, in this case there is a subdomain defined over k of type 
IV3 C IV4. So we assume d > 3. Then, as we have seen, the boundary component F' = I p -d,q-d will 
be zero-dimensional q = d (respectively F = I Pl -d, qi -d x • • • x I P/ -d, q/ -d will be zero-dimensional 
q v = d, V„. Here there are two possibilities: 



1) p = q = d, the group Np. of (|27|) is Nk = G . This is the case of hyperbolic planes. 

2) p> q = d, the group N k of fl27|) is over R just iY fc (M) = U(d, d) x C/(p - d) C f7(p, d) = G'(R). 



Note that in the second case the domain Djv fc defined by Nk is of type Id,d, a maximal tube domain 
in Ip, q . So we are also finished in this case. For completeness, let us quickly go through the details to 
make sure nothing unexpected happens. 

Proposition 6.2 Let G' have index 2 A^\, d = q, p>q, n+l=p + q, and let P' denote the 
corresponding standard parabolic and N' = Nk, where Nk C G' the symmetric subgroup defined in 
where H is the hyperbolic plane spanned by the vector which is stabilized by P' and its ortho- 
complement (v' : h(v,v') = 1). Then (P',N') are incident, in fact standard incident. Consequently, 
P = ReSk\qP' and N = ReSk\qN' are incident over Q. 

Proof: We know that N'(R) = U(q,q) x U(p — q) which gives rise to the maximal tube subdomain 
Iq, q C Ip, q of Table |2[ We need to check that the standard boundary component F' stabilized by 
P'(R) is also a standard boundary component of Pjv'i in particular we need the common maximal 
R-split torus in P' and N' . This is seen in fl27|), the R-split torus being contained in the hermitian 
Levi factor of P'(R), which is contained in iV'(R). Consider the group P' ON'; this is nothing but the 
stabilizer of v in H, which is a maximal standard parabolic in N' . Since v determines the boundary 
component F, both in G"(R) and in iV'(R), it is clear that F is a boundary component of *Dn'- It 
follows that (P' ; N') are incident, and this implies (see the discussion preceeding Proposition |5.7|) that 
(P, N) C G are incident. □ 

We are left with the following cases: III2 with index and I q;q with index 2 -^2d-i v d > 3. 
These indices are described in terms of hermitian forms as follows. Let D be a central simple division 
algebra over K (K = k for d = 2 and K\k is imaginary quadratic if d > 3) and assume further that 

D has a i^|/c-involution, V is a two-dimensional right vector space over D and h : V x V — ► D is a 

(2) 

hermitian form which is isotropic. Then d = 2 gives groups with index C2 { , and d > 3 gives groups 
with indices 2 ^2d-i i- 

Lemma 6.3 There exists a basis vi,V2 of V over D such that the form h is given by h(x,y) = 
xiy 2 + x 2 yi, x=(xi,x 2 ), y = (2/1,2/2)- 

Proof: Let v be an isotropic vector, defined over k. Then there exists an isotropic vector v', such that 
h(v,v') = 1, hence also h(v',v) = 1. Let v' = (u'i,^), and set 5 = v'iv'2, so that h(v',v') =5 + 6. 
Then the matrix of h with respect to the basis v, v' is H' = (5 g), where e = 5 + 5. Now setting 

w = (wi,w 2 ) = (-v{6 + v' 1 ,-v 2 5 + v' 2 ) 



we can easily verify h(w,w) = 0, h(v,w) = h(w,v) = 1. Since the change of basis transformation is 

,0 U 
\l 0) 



defined over k, the matrix of the hermitian form with respect to this fc-basis v, w is H = L n ). □ 



So as far as the Q-groups are concerned, we may take the standard hyperbolic form given by the 
matrix H as defining the hermitian form on V. We remark that the situation changes when one 
considers arithmetic groups, but that need not concern us here. At any rate, a two-dimensional right 
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-D-vector space V with a hermitian form as in Lemma 6.3 is what we call a hyperbolic plane, and 
this case was studied in detail in [Hyp|. There it was determined exactly what kind of symmetric 
subgroups exist. These derive from the existence of splitting subfields L C D, which may be taken to 
be cyclic of degree d over K, if D is central simple of degree d over K. In fact, we have subgroups 
( IfHypH , Proposition 2.4) U(L 2 ,h) C U{D 2 ,h), which give rise to the following subdomains: 



1) d = 2; V L ? 
embeddings of k. 

t n 

2) d>3;V L ^ 




x • • • x 



Tl 

b^Ti 



i , where Q : k 



denote the distinct real 







/ 



V T d 

In other words, for hyperbolic planes we find subdomains of the following kinds 

III! C III 2 , (Ii,i) d C I d , d . 



(31) 



The latter one is a polydisc, coming from a maximal set of strongly orthogonal roots, i.e., satisfying 
1), 2") and 3"). The first case is the only exception to the rule that we have symmetric subgroups 
N' C G' with rankaiV' = rank R G". 



Proof of Theorem |3.3| : We have split the set of cases up into the three considered in §4, 5 and 
6. Corollary 4.5 proves 3.5 for the split over R case and Proposition 5.7 for the rank > 2 case and 



positive-dimensional boundary components. For rank > 2 and zero-dimensional boundary compo- 
nents, Proposition |5.8| shows that with the exception given Theorem 3.3 holds in this case also. In the 



case of rank 1, Proposition 3.1 verifies 3.3 for the case that the boundary components are positive- 



dimensional, and Proposition 6.2 took care of the rest of the cases excepting hyperbolic planes. Then 
the results of [ Byp[ verify |3.3| for hyperbolic planes, thus completing the proof. □ 



Proof of the Main Theorem: The first statement is covered by Theorem |3.3| . The statements on 
the domains for the exceptions follow from (| 



and (|3ll). It remains to consider the condition 4). 
This is fulfilled for the groups N utilized above by construction. For the exceptional cases this is 
immediate, as we took subgroups defined by symmetric closed sets of roots. Let us sketch this again 
for the classical cases, utilizing the description in terms of zbsymmetric/hermitian forms. The objects 
D, V, h and G' will have the meanings as above. Let s = rank^G', and let H s be an s-dimensional 
(maximal) totally isotropic subspace in V, with basis h\,. . . ,h s . Let h\ € V be vectors of V with 
h(hi, h'j) = Sij, H' s =< h[ , . . . , h' s > and set H = H S (B H' s . Then h\ H is non-degenerate of index s, and 
H splits into a direct sum of hyperbolic planes, H = Vi © • • • V s . The form h restricted to H is 
anisotropic; the semisimple anisotropic kernel is SU(H^ , hi H ±). Fixing the basis hi, ... , h s , h' 1: . . . , h' s 
for H amounts to the choice of maximal fc-split torus S' . For each real prime v, (H u ,h u ) is a 2ds- 
dimensional R-vecotr space with zbsymmetric/hermitian form. Choosing an R-basis of H u amounts to 
choosing a maximal R-split torus of SU (H u , h v ), and a choice of basis for a maximal set of hyperbolic 
planes (over R) amouts to the choice of maximal R-split torus. Similarly, (H^~, h u \ H ±) is an R- vector 
space, hijj± has some index q u , and one can find a maximal set of hyperbolic planes W%, . . . , W r , such 
that H„ = (Wi) v © • • • © (W r )v © W, where h v \w is anisotropic over R. A choice of basis of the 
(Wi) u amounts to the choice of maximal R-split torus, and a choice of basis, over R, of V v amounts to 
the choice of maximal torus defined over R. From these descriptions we see that the polydisc group 
iV^ defined by the maximal set of strongly orthogonal roots \P splits into a component in SU(H, h\jj) 
and a component in SU(H ± ,hi H ±), say ./V^ = \ x Then Ny : 2 C SU(H- L ,hi H ±)(R) and 
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iV^i C SU{H,h\n). Since the subgroup SU(H- L ,h\ H ±) is contained in all the groups N we have 
defined, we need only consider iV^i. H is a direct sum of hyperbolic planes Vi, and the question is 
whether the corresponding polydisc group is contained in SU(Vi, h\y.). But this is what was studied 

in Pyp| ; the answer is affirmative. It follows that with the one exception stated, C 2 {, Ny C N. □ 
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